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(54) Method and device for achieving high contrast surface illumination 



(57) A method and device for acquiring data related 
to topography of a medium ( 1 4 and 44) includes project- 
ing light, allov;abIy from more than one direction, onto 
the surface of the medium at an angle (112 and 1 1 4) of 
less than sixteen degrees relative to the surface and im- 
aging the surface For example, the imaging sensor (24 
and 26: 73) may be an array of sensor elements that is 
used to determine navigaiion of a hand-held scanner 
along an original. By introducing light al an angle of less 
than sixteen degrees, surface irregularities cast shad- 
ows thai form a high contrast illumination pattem along 



the surface of the medium The navigation sensor de- 
tects multi-element variations (64) of intensity of scat- 
tered light from the surface with respect to positions 
along the surface so that the Nyquist criteria are ade- 
quately satisfied Typically, the light is collimated inco- 
herent light, but this is not critical. The illumination angle 
can be established by using a prism (31 : 38) The prism 
may have an antireflective thin film coating on one or 
more prism faces The employment of a prism provides 
a number of advantages, such as use of a transparent 
surface in contact with the media and raising the illumi- 
nation source(s) away from the media. 
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Description 

The present invoniior^ relates conorHlly \o devices 
ri'\'J rTiolnDds ti-r riCQ'jr mg dates foL-ited to icpogj.iphy cf 
n 'TiodiijfTi and more speci!icaliy :g i turnin,-ji;cn sowccs 
.i'id op!i:s lor nig-t-sDood a::quis tion cy position oncoc- 
in_) rj'KJ Of r^i,igo ftj::f oducir^c d.-I-i 

An accLJfalo- ooicr 'ntr^Hlion of rel itivc moveaTCr'l 
t>civV':tMi a dovi. 0 and a Sf'OC tic suff^-ico is important in 
n vrificty oi applic<-it 'jOS Fg- cx.-im-j\c the con:inLOU5 
mDvenieni ot a shod of paper :hrouqh h phot^ccpicr 
rTi iy be monilorc'd in c-rdor t d n lc-.v precise idonti'iCr^tion 
of the posi'.ion ot :no ^ noot along ri pHpoi path U S Pal 
No 5 149 9BC ic End cl al is assigned to the 

.-i^^sicnee of ihc prc£i;n' invention describes a molhod 
.-ind ripp,-jralus loi usmg a cross co rcl-i'ion lun.:li:;n to 
cJoiCffTuno the o*if>:arKo :h.it a sheet oi r.apL-r has moved 
in H given direct on through a prictocopier pnnier cr 
scrjnner 

In ihc pfe(LMfL (j crnbodrrierU ol Iho Erlol et ai moth- -^o 
<_>d ci linuni rin.-jy of li ^ht bcnsoc:* ib Lib'_d lu luce vu and 
sense light refleclt>d \tom the sheet of paper "?"hG p.iter.t 
notes thril (or practical applications it is nccessaiy to 
compromise bctwceri directing a light source sd .is to 
q.un :hc benefits .issociatcd with norma! light incidence 
and directing the light source to gam the benefit i assc- 
ciatcd with gra/mg incicJence At close to norrral inci- 
dence light refiocticn is highest but the light tencs to 
"wash out" the scifaco texture of the paper so that the 
surface texture cannot bo used to determine the dis- 30 
tance of sheet movernenl At the other extreme, light di- 
rected at a grazing inndc-'re vvil! produce exaggerated 
shadDwing ot the surface texture but the reflecti jn per- 
pendicular to the plane of the paper v.ill be minimal, i. 
e the light that reaches the light sensors will be min:- 3S 
mal Consequently the com.prcmisc is described as 
necessary for practical applications and the selection 
of the angle includes consideration of the proximity of 
the Ions barrel to the paper and any other light path ob- 
structions 40 

In the use of the patented method for determining 
the distance a sheet of paper has moved in a given di- 
rection paper fibers are viewed If the sensor array is a 
one-dimenstonal array the patent describes the imag- 
ing device as a CCD array ot 256 photo sites, each hav- -^^ 
ing a square configuration A single photo site is 1 3 pm 
X 13 Mf7i with the total length of the array being 3 326 
rnrn A one-fouflh power optical de-maynificdlion is 
used so tf Mt tfie CCD senses a section of paper tfiat is 
13 312 mmi long The field of view of an individual site so 
IS 52 pm X 52 pm A typical cress section of a paper fiber 
IS approximately 25 pm Significant image blurring is 
then used to prevent the higher cpatial frequencies from 
causing signal aliasing 

While prior art lechniGuos operate well for the ap- 55 
plications for which they arc designed, higher speed and 
or porlHhIo applications roqure significan' advances in 
energy efficiency signal-lo-noise ratios (SNR), position 



sorsif q precision anci a^: :jr.-,. y r^.rrj cc-rr-pv-i rt-v^s C".- 
oxHrnplr- ir- h h.^nrj rotd f>C': trAn cjo-ijr-'-.on t ^rnf r^,o' t:- it 
can acquire and stoie a fn tnful represent -it'ori c>l an ir-v 
a:jo oi a s:ar-ine j oriqin.-i: Typ;.:,-i!ly liie o :p!:...reJ in^rtfjo 
providec by t^~ii^ sc;,-if^r-ine do'.'icc is n pi«.e! :jri;,i nfi<-iy 
th.ii lb ^lorod in 'TK-inC'fV ri JiqiIhI fo^rn.jt A (iisto'tior 
f:oo irr .iqo requires a f.-i.tntu nvippinq o' t-t-: im.ij^o t. 
tno pixel d.-i'riaffay Sca^viers o'icr irx luce ri\ le-Hs: cne 
moans fci irnposinc ri rnecr .-nicnl con:,lr,-iir>i di.nrn In.-- 
imrjgc capture proc ess so -iS id ma.x ;'r ;/c tne I.KOhncjJ 
of faithful mapping Hew ever if a sc.-ir.ninq device is :o 
be used w thout such mc'crianic -il c ons'-.-^'n: tfif jI 'e- 
procuelior becon-'OS ri^oro J:fticull and t qu res sensirv:: 
t-,vo-difTK}nsiona; positions and lotations Tfio issues of 
cflicicn^v SrjR and aciu^-icv are of oc^ua" cc'nccrn ir^ 
printifi'.^ appliCHlions 

\ f-.e prof or reef ombodi'^icf^l seeks to prov :Je a co-m 
pact a;-id energy cfticioni method a- id clovice fc^r acqi. i 
inq accurate navig-.tic^n and. or Drint-imago ir if-: mn^t-or^, 
in a low-cost manner Iti.-il allows rcla:iv(}ly qu-ck rriowj- 
mont aciOiS d medium of mieiest It iri.-r/ riim-o piovsJe 
a device and method tnai acquires navigation infcrniri- 
tion sufficient to accommodate curviiincHf movemeni of 
the device cJunng an operation thai requi-es the device 
to be scanned 

Ac.:ording to an aspect of the present invent tc-n 
there isprovicJeda r)',oth':.c of acquifinr^d-il;i a^^ specified 
in ciair7-) 1 

According to another aspect cf the present inven- 
tion there is provided a device for acqjirsng data as 
specified in c alm S 

The preferred embodimien! provides an imaging 
metfnod and device in v^hich ai least one; illumination 
SDurce directs raoiation at a grazing angle of less than 
sixteen degrees relative to a surface of interest to pro- 
vide surface areas of high brightness and &urf-ji:e areas 
of low brightness By directing the radiation at an angle 
of less than sixteen degrees from a surface raised sur- 
face irregularities cast shadows thai provide a high-con- 
trast illumination pattern within a region of interest on 
the surlace In this embodiment, grazing illumination 
strikes the region of interest fromi more than one direc- 
tion relative to the normal of the surface Where high 
scanning speeds are required, simultaneous gracing 
angle illumination from multiple directions raises signal 
level and enhances detociabiliiy of the illumination pat- 
tern. If relative movement is initiated between first tne 
surface of interest and second an ariay of sensor ele- 
ments that aie fixed relative to tfie illumination souice. 
the high intensity features and low intensity features can 
be tracked in order to provide either or boih of positi.jn 
encoding information and image informrition for forming 
an image of the surface of interest Thus the imago fca 
tures of the surface define a unique pattern of surface 
topography, and the pattern is associated with the spe- 
cific region of the surface being sensed Moreover the 
pattern is more dependent upon larger surface features 
than individual fibers 
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The proforrod cmbodimonl of dotocting illumination 
foatiiros whore difiplHComont or motion js involverJ 
must salisf/ h cross-scctiondl 2 1 rntio of fiefd-of-view 
si/G to fOHturo st/e Nyquisl cntGria diclHto that tfie di- 
nnensions of shadows cast by surface irrcquirinties be 
Ht IcHSl twice as large as the tioldof-view o< an individual 
sensor elcrricnt For use of the method and device in 
roproducing an innage of the surface of a sheet of paper, 
the high intensity and low intensity features may be a 
result of surface roughness formed by a screen in the 
paper manufacturing process While the surface rough- 
ness IS not typicaily visible to the human eye. projecting 
the light at less than sixteen oegrees relative to the pa- 
per causes such surface roughness to cast shadows 
that provide an illumination pattern having sufticient 
depth ol intensity modulaton lor tracking features that 
satisfy the said cross section requirement I he features 
rendered with grazing light arc generally larger than pa- 
per fibers and thereby enable higher scanning speeds, 
as will be explained below 

Tl'^eie ate major adv/aiitages to illuminating surface 
features at angles of less than sixteen degrees Direc- 
tionality of lighting or colltmation is then required only in 
the incidence plane parallel to the surface normal, so 
that there is a greatly relaxed requirement for collimation 
in pianos orthogonal to such an incicionce piano As a 
consequence, multiple illumination sources can be uti- 
lized, or a source extending parallel to the surface and 
thereby able to define a large illumination area, can be 
utilized while still mooting the required degree of colli- 
miation within the planes ot incidence for achieving high 
contrasts Another significant advantage of sub-sixteen 
degree illumination is that by creating larger contrast 
fc -ttures sensor arrays with a fixed number of elements 
can have larger fields of view without violating the 
Nyquist criterion, thereby permitting capture of more sig* 
nal. This also increases signal strength by permitting 
longer sample integration 

In the embodiment in v;hich an image of the surface 
of interest is to be formed the surface irregularities may 
be print on the surface of a medium, such as a sheet of 
paper The sensor array and the illumination source may 
be secured to a hand-manipulable housing, such as a 
hand-held scanner As the housing is moved relative to 
the sudace ot the medium, signals from the sensor array 
track displacement of surface irregularities relative to 
the array For example, successive images of the illumi- 
nation pattern on the medium surface may be correlated 
to piovide navigation infor/nation regaiding the path that 
the housing is moved along the medium. 

The radiation from the illumination source will be re- 
ferred to herein as "light," but the radiation may be elec- 
tromagnetic radiation outside of the visible spectrum 
While the source of illumination may be a source of co- 
herent light, preferably incoherent light is used. 

There are a variety of structural variations for imple- 
mentation of the grazing illumination and a variety of ap- 
pl cations. as will be set forth in greater detail below 



With regard to illumination sources the grazing illumi- 
nation may bo (1 ) from a single source (2) from one or 
more sources, each in a ciffcrent plane of incidence or- 
thogonal to the surface but all directed onto a single sur- 

s face region in order to incfeasc apparent surface bright- 
ness without a corresponding significant loss of con- 
trast, or (5) from' more than one source onto separate 
portions of the surface region in order to provide cross- 
structured grazing illumination that improves symmetry 

JO within applications in v/hich correlation is a tactor With 
regard to two of the possioilities for arrangement of op- 
tical elements, light energy may be directed at the sur- 
face at the desired angle and then collected bolh by 
means of either ( 1 ) a pnsm having a media-contacting 

IS window or (2) a one-piece molded optic that deflects 
normally incioeni illumin^Uion into sub-six:oen degree il- 
lumination via a total-internal reflection mirror and that 
includes a recessed mccia window Possible applica- 
tions include medical imaging original image reproduc- 

20 [ion and acquisition ol surface navigatiori information 
In one implementation, collirnated light is diiected 
at the medium by means of a prism There are a number 
of advantages to using a prism to define the paths from 
the illumination source to the medium and from the me- 

25 dium to the sensor array One advantage is that the an- 
gle of illumination toward the surface is larger within the 
prism than the eventual sub-sixteen cegree or grazing 
angle upon exit from the prism for illumination of the sur- 
face of the medium This renders it easier to precisely 

30 translate a small cross sectional beam 'o strike a desired 
target region of a surface A second advantage is that 
the higher index of the prism means that less light will 
be lost through divergence in traveling the distance 
through the prism Two disadvantages of using a prism 

35 are that light into the prism must be much better colli- 
rnated and that the angle of incidence into the prism 
must be much more tightly controlled. 

Directing and collecting light by means of a prism 
provides a practical embodiment for grazing angle illu- 

40 minalion A prism allows use of multiple illumination 
sources as may be required to distinguish a number of 
colors or to increase the contrast. 

In one embodiment, tne light projection at an angle 
of less than sixteen degrees is accompanied or replaced 

-^5 by optics for allowing normally incident light projection, 
so that a user may select between the two forms of pro- 
jection depending upon the likelihood that the frequen- 
cy of raised surface irregularities will allow accurate 
tiacking of navigation 

so A thin film dielectric antireflection coating may be 

used on the distal surface of the prism in order to better 
couple incident rlluminaticn near the critical angle of to- 
tal internal reflection, thereby reducing beam power loss 
by reflection within the prism and increasing transmis- 

55 sion to the surface of the scanned medium 

A diffuser may be used to help meet the Nyquist 
criteria of the sensor array The diffuser permits the high- 
er spatial frequencies within the surface-texture images 



3 



EP 0 800 307 A2 



to bo bItjr.'Gd cr ■foKod off" v»,i;nc»ut s-iCnfirifig ;inv deptn 
of hold or siqoHi pov.or A bost rmhod mm: of this diJ- 
tusor IS ri cofnpulOf gcnor^lod difl'nc:ion olemer.l 
placed jjsl before If e imnainc^ nrrriy surf', r^.it incidcrt 
liCfit dircctod tDward a sincle sonsor elorno'M is 6\t\iHC\- 
od pdftiHlly to nearest roichbor olomcnts 

Rritf-icf tfian a pMsrTi a ono-pioco rriC'kle 'J optic m,i/ 
bo used to def oc: riorm-ill^^ incidonl niu-r.ic-iiiori ^nlo the 
desired lev. -angle iliunninalion via a lota! ini-: rnn! reflec- 
tion (TIR .■ mirror Moreover the c-ptic pref.:"ab'ly includes 
a recessed ou(-of-tocus dusi-p^oteclinq medium win- 
ciow Such a v.incov\ provides a cornacl optic that does 
not in fact contact the medium at tf:e tar pet area itsei* 
This reduizos the su:Dcoptibility of Ifno device and method 
to adverse effects o' imaging d^st dirt nnd scratches 
ar-d onab'es sub-si)^leen degrot) ■iluminan'T^n to be intrc- 
ducod bc=<jw the window m order tc- avc-id any compi - 
cations asso<:iated with passing ".ho low-angle illumina- 
tion through a glass -:o-air mterf.-icc that is oarallel to ifie 
SLfiace c' inior<.^st .I'j 

As pieviousiy noted colltm.-jior ; ar.d l. :>»..• of a prism 
are not cnlical to the invoniior, if fact a icw-spatial fre- 
quency texture of a single surface region may bo illumi- 
nated at sub sixteen degree angles from more than orio 
direction Without a prism to achieve increases in appar- 
ent surface brightness without compar.iole losses in 
contrast If areas of an illuminated sj^fac.e region arc 
sulf;(:iently low relative to surrounding areas such th^:t 
those low-lying areas will not bo illunninatod by grazing 
angle lighi regardless of its direi:nor preferably the ad- 30 
dKionat illumination is introduced from m:)re than one 
direction in order to increase the surlaco bnghlness at 
thD high-lyinq areas withojt a significant loss of shad> 
ows at the -ow-lying areas 

in another embodiment, the rector of interest is di- 3S 
vidcd with respect to direct ons of itlum-nat on As an ex- 
ample a first grazing angle illumination is oriented gen- 
erally along the direction of rows of sensor elemients in 
a sensor array while a second grazing angle illumina- 
tion is orionled generally a-ong the direction of columns -^o 
in the array If each illuminated region is 32x32 pixels, 
the sensor array may be 32x64 elements although 
there may be some intentional or unintentional overlap- 
ping of the two iliuminations By dividing the region of 
interest in this manner, any preferential orientation of im- -^^ 
age contrasts in the media image is at least partially off- 
set whotfier caused by media anisotfcpics or by the il- 
lurnifialion direclionalily 

An advantage of the prefer led rnetlioJ and device 
IS that the projection of light onto the sudace of interest so 
at an angle of less than sixteen degrees relative to the 
surface provides a surface illumination p.jttern that is 
rich in contrast By tracking only those features of the 
illumination pattern that satisfy Nyquis: criterion on the 
cross sectional relationship with the field of viov/ of the 55 
sensor elements and/or by using a prism or similar op- 
tics In first direct and then collect the light a practical 
embodiment of gra7ing angle illumination and detection 



IS ,-i.:hiovoci Tna: i-:, tno nooo to ost.ib i cot :jromi:- o 
hoKV'-^rr^ grn/ing Hr-,n!n ar^1 nonr rp.o'^d.r ; : iliur ifVi- 
ton ris taught by the r:bove- dc':lil eo pa.ont to Ertol ei 
IS rvercomo 

Tlie d rcMiO'i .i! v.'+iicn li:;ht is prcjoulcc roL-itivo lo 
.-1 riiroclion of \'ri\ o\ o- thr' senior ,-i'r.-iy .-jiori^ !ho su". h:o 
ct inioroivt IS one ir.-ncr f.iClcr ifi ifo aevolopr^-'ont of a 
SL.-fficiofitiy hipn sigrial-lC'-noise n;.:) to p-ovae reh.jblo 
positic-n-oncoding or ir7V:ge-reproduc*:on irifofrr ation A 
iccon'j irnoodr-int *.-iCto' .s rcr-^iovinq lov. spr^i a I frocuon- 
cy variat;ons as rTiight be caused by urir:voidabie noii- 
uf"!!fOffrit:03 -n illumination across :[-e f j'' sofis^r nrray 
field cf view Preferably the processing circjilrv irr- 
cludes DC rcmcv.i! cirrjits Iha* tr.-ins'or-n !hc- original 
imaging r-f the illurTi:na!:c;'r-' patten into an irrv^gc of Ic^cni 
di'terercos -io tnnt the .cw spat. a' treqijoncio;;: arc r^?- 
moved but these are pe'erential lo the directions in^it 
cnn be locally differenced i o prefer cnti,-' tc^ rows or ;o 
columns cr to pnr^cipa! diagcials The Ifiird facloi n- 
v.'lves Iho nurnt'Or ol rows and Ifu nurnLof of columns 
uf bensur elo'nents in tli^- array Thugieatei tlienuiTiber 
of elerTier-ils in one direction the greater tf-ie renderablo 
cC'ntr.-ist in accumulation of data wilfi respect to that di- 
rection Thus there is a ccr relation between the nurribor 
o' cIcrnentG anc the signal-to noise ratio uoon mov:- 
rriont in a particular direction E5y accounting for each of 
ti-io above throe important factors the strengths of one 
can bo used to offset the weaknesses of cjne or both of 
tno others in order to allow adequate corrolation signals 
for motions in any cirecfion over the surface 

An embodiment o' the present invention is de- 
scribed belov/. by v/ay o* exar-^'ipio only v. ith rcfcrenc-:- 
to the accompanying crawings m v;hich 

Fig 1 IS a perspective view of a preferred embodi- 
ment of hand-held scanning aevice following a mean- 
cfering path on an original 

Fig 2 is a surface pl.-in view of imaging and naviga- 
tion sensors of the scanning device of Fig 1 

Fig 3 IS a perspective view of the scanning device 
c-f Fig 1 . shov/n with the imaging and navigation sensors 
exposed 

Fig 4 is a schematic representation of a prism and 
grazing angle illumination from more than one light 
source 

Fig 5 IS a schematic representation of grazing an- 
gle Illumination using a light source miounting adjacent 
to a navigation sensor wi:h an anlireflection coating on 
a prism 

Fig 6 is a side view of an embodiment Itiat utilizes 
a one-piece molded optical element to achieve the graz- 
ing angle illumination 

Ftg 7 IS a front view of the embodiment of Fig 6 

Fig 6 is a schematic representation of an embodi- 
ment using a switchablo combination of grazing angle 
illumination and normal incidence illumination 

Fig 9 is a conceptual view of the image capture op- 
eration of the scanning cfovice of Fig 1 

Fig 10 IS an operational view of one embodiment 
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o( iho nnvigation processing of Iho scanning device of 
Firj 1 

Fig 1 1 IS a schcnnatic view of selected steps of Fig 

9 

Fig IS a schematic view of an embodiment with 
Cfoss-slfuclured qra/inzjanqlo illuminrttion 

The preferred method may be ulih/ed in any of a 
vhricly of applications including mectcal-rclated and 
compuler- 1 elated applications For the purpose of un- 
derstanding the method will be descibed with refer- 
ence to computer scanners 

With reference to Fig l a portable hand-held scan- 
ning device 10 is shown as having followed a meander- 
ing path 12 along an original 14 The criginal may be a 
piece of paper, an overhead transparency film or any 
olner imago-beanng surlace upon which illumination of 
the original at an angle of less than sixteen degrees will 
generate sufficient contrast to provide position informa- 
tion during navigation along the meandering path. Typ- 
ically the low inlensily and high intensity features of the 
resulting ill ufTimatior^ pattern are tracked and the posi- 
tion information is used to rectify imago data but other 
embodiments will be described The scanning device is 
preferably self -contained and battery powered, but may 
include a connection to an external source of power or 
to data pons of computers or networks 

The scanning device 10 of Fig. 1 may include an 
image display 16 The display may provide almost im- 
mediate viewing of a captured image However, a dis- 
play fs not essential to the use of the scanning device 

The scanning device 10 allows three degrees of 
freedom, with two being in translation and one in rota- 
tion. The first degree is the side-to-side movement (X 
axis movement) along the original 14 The second de- 
gree of freedom is movement upwardly and downwardly 
along the original (Y axis movement). The third degree 
of freedom is the ability to operate the device with rota- 
tional misalignment of a linear array of image sensor el- 
ements relative to an edge of the original 14 (H axis 
movement) That is, the lineararray of imaging elements 
may have an angle of attack that is not perpendicular to 
the direction of device translation. 

Referring now to Figs 1-3, the forward side 18 of 
the scanning device 10 may include a pivoting member 
20 that aids in maintaining proper contact between the 
original 14 and an imaging sensor 22. Navigation sen- 
sors 24 and 26 are located at the opposed ends of the 
imaging sensor. Because [he navigation sensors are 
mounted on the pivoting member, the navigation sen- 
sors are in a fixed location relative to the imaging sensor 

For reasons of physical compactness, the imaging 
sensor array 22 is preferably a contact image device, 
but for applications in which compactness is loss of a 
concern or a smaller image is desired, sensors employ- 
ing projection optics may be employed with magnifica- 
tion less than unity In such applications, the elements 
of the imaging sensor 22 should be smaller and more 
closely packed together Contact imaging devices typi- 



cally employ lenses sold under the trademark SELFOC 
which IS a federally registered mark of Nippon Sheet 
Glass Company Limited Less conventionally, contact 
imaging can be obtained using interleaved array elo- 
5 ments of sources and proximal sensors, v/ithoutany im- 
aging lenses Conventional imaqinq sensors for scan- 
ning applications may be used The imaging sensor may 
be pan of a unit that also includes an illumination source, 
illumination optics and image transfer optics 
to The imaging sensor 22 is shown as a linear array 

of discrote optically sensitive elements The spacing of 
the elements plays a role in determining the spatial res- 
olution of the scanner 10 For example a linear array 
having a length of 101 6 mm requires 1200 sensor ele- 
'5 rnonts to achieve a resolution of 300 dpi The sensor 
may be a charged coupled device (CCD) an amorphous 
silicon pholodiode array or any other type of lineararray 
sensor known in the art 

A key consideration tn the design of the imaging 
sensor unit is speed The imaging sensor 22 preferably 
IS able to image eacfi pixel at approximately 10K sam- 
ples per second Linear imaging arrays generally pro- 
duce a serial data stream wherein pixel values, i e 
charges, are placeo into a shift register and then shifted 
2S out Achieving the desired speed requires cither very 
fast serial transfer rates out of the entire image array or 
multiple taps, so that pixel values can be shifted through 
fewer cells This introduces parallelism, which is advan- 
tageous for digital processing 
30 Another consequence of the speed requirement is 

that the products of p^xel areas at the surface of the 
original, and their solid angles of emitted light collected 
and conveyed to each array element should be suffi- 
ciently large to produce a detectable signal in integration 
3S times on the order of 100 microseconds. An enhance- 
ment option IS to add an optical element to the sensor 
to increase the effective fraction of sensor pitch for 
which each sensing element is responsive. Since there 
is typically unused area in the array matrix such light 
-^0 collection optics increase sensitivity 

In Fig. 1 , the meandering path 1 2 is shown as hav- 
ing four and a fraction swaths, i.e. side-to-side passes 
across the original 14. A useful imaging sensor 22 for 
most opportunistic applications has a length within the 
range of 25.4 mm and 101 6 mm. If the sensor 22 has 
a length of 63.5 mm, an A4 paper can be scanned in 
four or five swaths. The swaihs should include regions 
of overlap, so that a stitching process can be used to 
produce a faithful reproduction of the oiigma! image 
50 The scanning device 10 typically includes at least 
one navigation sensor 24 or 26 In the preferred embod- 
iment, the device includes a pair of navigation sensors, 
with the sensors being at opposite ends of the imaging 
sensor 22 While a one-dimensional array of optoelec- 
55 tronic elements may be used, in the preferred embodi- 
ment, each navigation sensor is a two-dimensional ar- 
ray of elements The navigation sensors 24 and 26 are 
used to track movement of the scanning device 10 rel- 
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Htivo to Iho Of iqtn> ii ' 4 

Thp n.AinHfiOfi '^nr'^nr^ 24 nnc P6 of F O] 2 o.tier. 
lively observe h mcv ng irnngc of :he orir^in-il 14 nodprc- 
&^:.c- iic- indi:<^tiori o" !ho d ::ip H-:cr"ncni ir: iv.o pUn.'^r d^- 
rT^er^hioriS bfMweer- :^i..v:ossiv:- obscn.'ritr vi? As will be 
o>pl.:!Mt:- :i rrioro t.^lly below pixe' Vi-Ilcg ''C'-ti the ravi 
Q st^ns'jrs H'e o::of.-itec} upon by pfo-.:essi"ig ole- 
mor^-; > lo delerfTMne proper rn.-ipptng o? imnqe dntd ffon 
the ifTV-igir^p sonso' 22 Th-: processinq clomonts opcr- 
ci'.-jo-] p>afticul,-ir pixci afid -Is rnearest no ;^ i^jor s to pre- 
duce Hfi H! fiy of co^rel.-i'io-i values a: each oixcl loca- 
t ;.;n rne c Drr el.ilior- \.alijo> a-o based udc compari- 
sc'rTs oetwcr ri a curren: image of the surf iCt:- structure 
and a storo'J image roprcsenVng a known position of in- 
hoierit sifuc tural featLJ'os wherein t^o si: roc image 
server as a positiC'". reicrence However operatons 
oi'^ier iti.-in :fie c-: 'relation p^c>'CGSS may br enO'Oyed in 
m ini:>ui.-iiing tnc- ;npjt image data to term Ihc oulpu: im- 
age 

Referring new lo Fig 4 navtealton sensor 24 is -^0 
sf jwti ris being operative ly assoc iated witti i? urr.ination 
op:ics I! the original 1 4 is a papc product 'or which sur- 
fa:e irregularities are to be detected by tht? navigation 
sensor 24. the irtrc.duction of light at a qra/ing angle 
Cc:UGCs thic surface irrcaulanties to cast shad i-ws there- 
b^ creat*ng an illumination pattern tf^a:. is rj:;h n contrast 
betweori brightly illuminatGd raised surface features and 
darker snadC'Wed areas between the raised surface fea- 
tures Whitle not essentia! one or more light .-milting di- 
oces (I EDs) 28 and 30 may be used as i: tjrTtnation oo 
sources The gra^'ing angle, which is the cor^-.plement of 
the angle of incrcencc is in the range of zero degrees 
ani:i fifteen degrees dcipending upon the pr.;)periies of 
the original 14 The optics may comprise a single ele- 
ment or a comb nation of lenses, filters and/or hole- 3S 
graphic or diffractive elements to accomplish suitable 
coMimated and generally uniform illumination of the tar- 
ge! surface The wavelength of the light ennittec by the 
source 28 and 30 should be selected to enhance the 
spatial frequency information available for nav!gation -^o 
Fixed pattern noise in the illumination field should be 
minimt^'ed The o Jlput of source 28 may require adjust- 
ment to accommodate wide dynamic ranges of reflec- 
tivity of the original as the scanning device proceeds 
over printed materials with absorbing or reflecing inks -^^ 
or other marking agents 

The magnification or demagniftcation of navigation 
imaging optic s should bo constant over (he field-of-view 
of the tW(3-dir7ien5ional sensor array 24 which detects 
the imaged light f'om the surface In many applications 
the modulation transfer functions, i e the amplitude 
measure of optical frequency response of the naviga- 
tion opticr. must be such as to provide attenuation before 
tho Nyqu'St frequency that is determined by tne pitch of 
the sensor elements of the navigation sensor and by the ^5 
magnification of tho optical elements The optical ele- 
mrints should alsn be designed lo prevent background 
illumination and stray light fr<jm creaTinc ncise Note that 



a Wcivofront sp';ttirvj t^-eariT -splitter coeici alsn be usee 

liluminalmq a Inrgn! regrifi of h'"? originnl '4 at nr. 
ariqle of less than sixteen degrees works well for appii 
cations tn which the surf(-i...:o of trie rna na! has a higr-, 
deqroo of uncvenruiss For o>;reT^ple Intj r^lfoduclicin o* 
hqfit f'Om the source 2r a: qid/inq r;r"gle provides <i 
tTiqh siqnal-te' noise r.itio o: da! i roi.iie J to surf.ice fen- 
lu'os when tf e original is siatie-nerv c^irdbCnarc fabric 
or human skin Gra.'irg ang es of il-umin-jtion cenera'o 
longer shade ws c.nd more .-:p;:areni c jrlirist than v.ili 
it Limination p'ojected at an angle ci si>tecr-. degrees or 
greater relal.ve to the surface M trie or.gna That is if 
Iho surface c-' tne original is r^o: *'!-jt srTtoe'th and glossy 
the: AT signa Heve h'i. greall^ en:i -iriced t y use of gra/ing 
af.qlos of rluninriiie On tf ie clhor ha'id tf ;e DZ signal 
level increases as tfie !llumi;-^-iti >n angle- r^opfoachcs the 
f-icr-nal to the ong-nr-:l 

Fi:^ 4 illjslrritos an cmtKKJrnOfV C:f achieving a 
gr.-i/in:} ar^glc of illeminatiC'n bv moari , of a prism 3i 
Tfie prisrTi rn.-iy be rr ado ol cornrnij-r'. ophcal c:rown glas;;- 
sucli as the type s<>l'.J by Schott under tne model numbtji 
DK-7 glass fo' which n : 1 5ic5 Two ill-..mination sour: - 
es 2G and 30 project light th-l is collectod by lenses 32 
and 33. respoclively and coliin". ited before entering the 
prism 21 The light is rcdircelod upon cx ting the prism 
to £trl^o a surface of tho original at a grazing angle of 
less than sixteen degrees to tho surface of tne original 
Light scattered from a target 7one of tne- surface is col- 
lecteci by an upper lens surface- 34 o' the prism and is 
directed at the navigation sensor 24 Ihc navigation 
senscir may be cloeke<d electrC'nfcatly tC' provide succes- 
sive frames of tho ilium inat'on pattern at the surface 
The seccessrve frames may be corre'aied in a manner 
to be described below, but correlation is not critical 

In an acceptable embodiment, the prism 31 has fac- 
es 35 and 36 whose normals are sloped by approxi- 
miiitely 40 7 degrees from Ifse normial of the surface of 
the original 14 Such a slope permits the light emitted 
from the illumination sources 28 and 30 to be normally 
incident onto the prism faces, so that the central rays 
arc unhkely to undergo any significant refraction upon 
entering the prism Thus central rays cf light can be 
made to strike the distal face 37 of the prism 31 at an 
angle of 40 7 degrees, slightly less than the angle of total 
internal reflection tor BK-7 glass The light transmitted 
fromi the distal face 37 will be a* a grazing angle to the 
surface of the original For BK-7 glass and an angle of 
40 7 degrees the incidence angle of ligfii striking a tar- 
get zcjfie of tfie original will be approximately 32 degrees 
with respect to the normal of the surface i e a grazing 
angle of eight degrees with respect to the plane of the 
surface In practice, the illumination beams should bo 
positioned to be centered around a target zone cf the 
surface The target /one remains stationary relative to 
the prism 31 but rnoves relative to the surface as the 
scanner is relocated 

In the em,bodifr.ent of Fig 4 t^e Ions surface 34 of 
the prism 31 is shaped with rotational symmetry about 
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an oplical axfs dofincd by the conlor of the navigation 
;^rrHy 24 nnd Iho center of Iho l^rgot 7onn of the surfnco 
ol the originHl 14 While not shewn the lens surface 34. 
which exhibits opticHi power may bo replaced with a pla- 
nnr segment and a lens or lens system separate from 
the prism qoomotry could be used to image the target 
/one onto the navigation sensor 24 In yet anolher al- 
ternative embodiment, the op:ical power of the collima- 
tion lenses 32 and 33 could be achieved by properly 
shaping the prism faces 35 and 36 

Where the navigation determination is to be ac- 
quired via image correlation accuracy and precision of 
the determination may be enhanced by improving the 
uniformity of illumination over the imaged taiqct zone of 
the surface of the original 14 Illumination uniformity may 
be improved by employing techniques ot energy rema- 
pping, such as by suitably reshaping two or more ol the 
optical surfaces in the illumination path of each of the 
sources 26 and 30. As an example, the surfaces ot the 
collimalion lenses 32 and 33 and/or llic pr»sm laces 35 
and 36 rnay be reshaped If there is a refracting surface 
in the construction of the illumnation sources them- 
selves these surfaces may also be employed in the en- 
ergy remapping Such remapping to accomplish uniform 
power across beam cross sections is known art, but the 
flexibility in incorporating part of the energy remapping 
optics into the prism design is considered novel 

Opt onally, the preferred embodiment rnay incorpo- 
rate a diffusing function onto the lens surface 34 of the 
prism 31 A separate or alternative diffusing element 
may also bo used between the prism and the navigation 
sensor 24 The purpose of the diffusion is to transform 
the signal power into spatial frecuencics either near to 
or lower than the Nyquist limiting spatial frequency 
(which is related to the pitch of tne sensor elements of 
the array 24) That ts. a diffuser would provide a roll-off 
of spatial frequencies which could otherwise cause 
aliasing in the correlation operation and at the same time 
boost the signal energy of lower spatial frequencies. 

The use of a grazing angle of illumination to achieve 
a high contrast illumination pattern along the target zone 
of the original 14 is not limited to acquiring navigation 
data Projection at a grazing angle will cause raised print 
on a page to cast shadows, so that this embodiment may 
be used to form an image of pnnl on a page 

There are a number of advantages to employing a 
prism 31 to provide grazing angle illumination from a 
source 28 and 30 of light Firstly, as shown in Fig. 4, 
multiple sources of illumination may be used simultane- 
ously without as much loss in contrast Also, the prism 
lowers the loss factor due to geometrical projection of 
the illumination beam and the consequent surface 
brightness at high points of the surface that arc in inti- 
mate contact with the prism face Without the prism the 
loss factor is cos {90°-&'^) = 0 1 39 at eight degrees graz- 
ing incidence However with use of the prism having an 
index of refraction of 1 51 85 the equivalent loss factors 
become cos (90'*-40 7°) := 0 652 Consequently, the im- 



provement tn this factor with use ol a prism at eight de- 
grees over no prism is 0 652/0 13*^ 4 

Another advantage of the use of the prism is that 
divergence of the incident beam within the prism is re- 
5 duced Moreover, there no longer is a strong need for 
collimation in any plane perpendicular to the plane of 
incidence where the plane of inc:idoncc lies parallel to 
the surface normal Thus, a number of illumination 
sources may be arranged around the normal viewing ax- 

?o IS yielding improvements in the illumination irradiancc 
by the same multiple as the number of sources or con- 
sequent increase in total source area 

Yet another advantage to using a prism 31 in the 
optical detection path is that it provides an opportunity 
to use the faces of the prism to mount navigation optics 
without significantly widening the overall package A 
prism may also provide a significant reduction in the tol- 
erance required to iranslationally pos lion the illumina- 
tion at the target zone of the original 1 4 since the beam 

20 cross section which projccls onto the lai gel is larger with 
the prism than without it The leduction in the tolerance 
using a prism is inverse to the ratio of the cosine of the 
incidence angle before leaving the pnsm to that after 
leaving the prism. Controlling the beam angle to aim the 

2S incoming beam of illumination to strike a region of inter- 
est of an original 14 at the desired grazing angle how- 
ever becomes more demanding with the use of a prism 
Another disadvantage of using a prism in the above 
manner, wherein the illumination is injected into the 

30 prism along the normal to the input face, is that the input 
beam must be collimatcd better within the plane of inci- 
dence as well as aimed more precisely in angle These 
two effects can be reduced by embedding the source 
within the prism medium or reduced or eliminated by in- 

35 creasing the slope of the first prism surface and increas- 
ing the angle of incidence as shown in Fig 5. 

Referring now to Fig. 5, a prism 38 is shown as hav- 
ing sloped prism faces 39 and 40 to allow incident illu- 
mination from a source 41 to be initially parallel to the 

•io normal of the surface of the original 14 The angles of 
the prism faces 39 and 40 are approximately 81 .43 de- 
grees, again assuming that the index of refraction of the 
prism material is 1 .5185 This angle is also the angle of 
incidence of light that strikes the surface after being 
emitted from a prism 

The embodiment of Fig 5 permits the incidence an- 
gle at the distal face of the prism 38 to be the same 40.7 
degrees as described with refeience to Fig 4. Conse- 
quently, the pii&rn may have a lens surface 42 identical 

so to that of the one described with reference to Fig 4, That 
is, the lens surface 42 collects light from a target zone 
of the original 1 4 and images the target zone onto a nav- 
igation sensor 24. Both the navigation sensor and the 
illumination source 41 are shown as being mounted to 

55 a contact surface 43 of a scanning device 

The distal prism face, i e. the surface of the prism 
38 that IS closest and parallel to the surface of the orig- 
inal 14. should be kept in close proximity to the original 
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\r. 0(00' \n;-i\ W e l<-trqot /onr? \s t-oni in tocus Ht the arrny 
r-.- ;in'j n ordor innt tho ligh( omprrjinq ff-^rr, {ho p'lsr^ 
iuii. ill:;f7iin lies ine tared /or-e The \\ dth oi the ilium - 
r..^\\'-y^ t'Ori:ri ffOft! the sourco 4 1 IS dcsigrod lo be sul- 
li-iorMly t:'ro.-i;:i !n;it the inrge! /one 'CfTinins ful'y iliumi- 5 
'^• itcd Cv Or: if there il- sonvz- r';jri-hiU':>n IjCwcon the 
pfisrn , ir.d Ira • or iqinal 

A cotKOf'^ th.it arises Vvif^: the use of i.-.e p)risrn 3c 
rolrifes :o refioclirn losses Rcf octiofT losses can besic- 
nnc.-.nt especially tor poi-in/Hl.cn porpGndi ruirif ic the 
pl.-inc of inciconcc The prism 35 o' Fig 5 ircljdes an 
riniireflec:ivc coaling 45 =n o'der to iniprovc iransmil- 
t-mcc ,-}n-:j recujce reflection Ic-sses While riot shown 
proferablv lh(} v.- nous laces c? the pnsrii inciLdc the 
afiiiroflec:ive ccTj:ing Sonne C Iho potent.,-! roMcction 
loiS'i's are liustralcd by dashed lines in l-ia 5 \n cotr- 
p-if'5.on the rctiCfCtion iro'n the distal l.^ce 3/ in f-ig 4 
Vvill 1)0 partially rodirectea by lotiociion trom the pnsm 
faces 35 and 36 to comtDine with the cngifial beams in 
boing iJi'cc:ed at :ho dislni frice 37 anc Ihu-- vviP not be- "t"' 
ctjns'j .-1 soufcu 'jl pat to 'M noise 

The cintireflective coating 45 may oe formed using 
knov.n thin-film multilayer dioloclric cc-ting techniques 
For oxanr.pie. a two layer Vccat with the aopropriate 
choice cf index rriatcrialc rjnd ihickncGS may be .::pplicd 
Without an antiKiflective coating at the distal face, the 
roflo>:tions of tlio paralici anc perpendicular compo- 
nents of pclan/ation at the incidence angic- of 40 7 de- 
gree-, lor an indo< of refraction of 1 51 will no approx- 
imately 36^'o and 65%. respectively The two layer V- 30 
coat having the appropriate cf-ctce ot index materials 
and tnic-<;riCSG reduces eithier c r-.o of thioso ro'tec:ions to 
below 1% and reduces the other reflection to below a 
few percentage points 

The illumnation source 41 may be a source of in- 3S 
coherent light, but this is not critical Incandescent 
lamps, light emitting diodes, laser diodes and laser di- 
ode arrays may be utilized For a hand-held scanner 
the use of a light emitting d:ode is preferred, since it pro- 
vides reliability and comp.^ctness Coherent sources are -^o 
acceptable, but may cause problems by producing 
speckle It is possible to cast a light emitting die directly 
in:o tne prism 38, in which case the illuminalion source 
could be positioned very rea^ the target zone, with re- 
flective cups and/or diffraction "lenses" being configured -^^ 
to obtain the desired collimation 

The pnsm 35 may be formed of any of a variety of 
mdterirdls Molded glass, ground glass polished glass 
and molded or cast plastic are suitable materials 

In comparing Figs 4 and 5 a single illumination so 
source 41 may be used to provide the grazing illumina- 
tion of the original or a number of sources 2S and 30 
m.fiy be used In some applications the multidirectional 
"floodlighting" in Fig 4 effectively increases the appar- 
ent surface bnghtness without a corresponding loss in ss 
contrast For example, if the texture of the original 14 
defines a raised net-like pattern the Icw-lying areas of 
the illuminated region may bo sufficiently low so as net 



to intercort rnys rr-Mrdic-,. of the Juoclion frorv v;hich 
l^" '-^ C]iH/\:--c] iii;j'Ti n nor i> ^Miair^^ted \r. ^\.r.h ;Hrr4->e the 
mulli-sourco embc 'Jimorr of Fig 4 is prcferrod By pro- 
Vidifig mo;e t^ir-n y\c scjr^e o" illjmn.aiiDr the nigh- 
lying .-kc.-is of i-e iMurnirv-ioJ logion scatter a greaio^ 
intonG-i:y of liq^' 1^1 the .v-lynq .-jftins rcm;-3in with'n 
shrioows " uitriormore if t'le illiminnt on remans at a^, 
angle ol incidence ct less innn si>.teen degrees the lignt 
need not t:e col;im.-itec in orcer to obtain sufficient con- 
trasl in ar ima:^-: ci the l^.-qct rrgic^n 

Ro'ernnc now lo Figs c .-ina 7 h ono-picce mo'dod 
optic 53 IS provi Jed in order lo iJeflect normally incident 
il urrnnritrci". frorr source 55 irito suo-si<tecn de-'^ree 
il urTiination at a large: th^^t s represented by line 57 
The cptic dcflecs inc illu 7i,nHtior^ h sjrlrice 5'^ that 
lunclions as a lota •intern-il fct:':oti:)n ( fM) mirror Iho 
surface b9 .s ne.-r 4-' degrees rdalu'e to the illumination 
fforr the source 5t The source rriay be ac) LED with a 
single lens arc orie or sovor.-il squr:ic die or may be nn 
LED having a J; i' gl" roclrnqjhir die The LE 0 lens may 
be rufiactmg o- dit-iricting 

The lii^ht from the source 55 is ref.ecled at a region 
61 of the TIR mirro' 59 The reflected I ght energy p.iss- 
es through an cpli : to-air interface surfac e 63 pric^r to 
reaching the target region 57 of the surface of interest 
Consequently, the contact surface 65 of the optic £3 is 
separated from Ine Inrget fo :)ior ihat is illuminated Re- 
flection from the t.-roet rG;5ion enters the optic 53 at a 
reccsseci surface 67 The rofloctod lignt energy passes 
through the opiu: tc- strike an oft-axis elliptical mirror or 
reflecting diffraciive Ions 69 From the mirror or ciffraetor 
69. tne light energ; is directed lo a f*at mirror 71 that 
redirects the light energy to a two-dimensional array of 
sensor elements 7 3 Consequently the reflected light 
follows a folded path from the target region 57 to the 
sensor array 73 

The recessed surface 67 that is out ol contact with 
the surface of interest is associated with a number of 
advantages. The optic 53 may be considered to have a 
recessed, out-of-focus dust-protecting media window 
The window acts to keep dust, dirt, and otner foreign 
matter from entering the interior of the unit. Moreover, 
the window is remcved from the image plane (i e.. the 
plane of the surface of interest) to reduce the suscepti- 
bility of the surface 6/ lo scratches and dust that would 
be imaged by the sensor array 73 The recessed window 
also enables the sub-sixieer- degree illumination to bo 
introduced below iho level of the surface 67. Ifiereby 
avoiding any cornplicatior^s associated With :ntfoduc ing 
grazing lignt through a g!ass-lo-air interface immediate- 
ly adjacent to the surface of interest Instead, the illumi- 
nation IS passed through a G;dcwall v^mdow surface 63 
that forms an edge of the recessed window 

Referring now to Fig B. norrrial incidence illumina- 
tion IS shown as being provided as a selectable alterna- 
tive to the grazing angle illumination of Fig 5 An illumi- 
nation source 4^. ciirecfs light to a reflective element 47' 
that IS centered on the optical axis from a navigation 
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sensor 24 to a target /one of the original 14 The light 
rofloctnd by tho optical elemont 47 provides iliumination 
of the target /one at generally normal incidence to the 
surface Note that the marginal rays of tho illumination 
beam at the 45-dcgrco optical element 47 do not sub- 
tend as large an angle from the target /one as does the 
lens surface 42 itself This is to permit only those scat- 
tered rays that lie more than five degrees outside the 
marginal incident rays to pass beyond the 45-degree op- 
tical olcmenl and be received at the navigation sensor 
24 

Tho use of incoherent light at a normal angle of in- 
cidence m^y be preferred in applications in which posi- 
tion or image data are to be acquired from originals such 
as photographs, glossy magazine pages, and overhead 
transparency films While tne Driginai may not have sut- 
ticienl surface roughness to reliably determine naviga- 
tion along the original by means of tracking shadows 
and highly reflective raised surface features, the original 
may exhibit rich texture when viewed live degrees or 
slightly moio away fiom the duectiofi of reflection, since 
light scattering from inhomogeneities in refractive index 
in the original 14 or from defects in surface coatings or 
films will provide the required basis for determining nav- 
igation 

Coherent illumination may also be introduced at 
normal incidence in order to permit speckle-based nav- 
igation Relative motion between a scanning device and 
an original may be tracked by monitoring motion of 
speckle relative to one or more navigation sensors 24 
If coherent illumination is used without using imaging 
oplics- then by selecting a small area of illumination and 
by having a relatively large separation between the sur- 
face of the original and the navigation sensor the result- 
ing predominant speckle cell sizes with coherent illumi- 
nation can be sufficiently large to satisfy Nyquist sam- 
pling criterion. 

The use of a larger aperture beam splitter or even 
a similarly large annular reflector instead of the smaller 
reflector 47 allows both the incident illumination and the 
detected scatter to be normal and/o-^ near normal to the 
surtace of the original. These latter field arrangements 
provide excellent features of high brightness and con- 
trast from photographic media tn particular but require 
the image to be magnified in order that the features be 
larger than typical sensor array elements It does not 
work well on diffuse media 

Grazing angle illumination is accomplished using a 
prism 38 and a source 41 of illumination similar or iden- 
tical lo the prism and source of Fig 5. Light from the 
source 41 is redirected at a first prism face and is then 
projected cnto the original 14 at a grazing angle upon 
cmiG.sion from the distal face which is at the surface An 
image of the target 2one of the original is formed at the 
navigation sensor 24 

While this embodiment has been described and il- 
lustrated as having a prism that includes surfaces hav- 
ing specilied slopes, other configurations of prisms may 



bo utilized to accomplish the desired grazing angle of 
illuminrition In fact a pnsm is not a cnticnl element 
since tho grazing angle can be accomplished using oth- 
er knov/n optical elements such as mirrors Additional 

^ optical elements mny ,-iIsg be employed for various pur- 
poses such as trapping or baffling ol stray light or to (1 ) 
improve the power distributions in beam cross sections 
(2) define beam apertures (3) block specularly reflected 
light and stray light, and/or (4) improve collimation in the 

to planes where this is necessary to maintain a high con- 
trast in the navigation images o' tho surface 

Refeiring now to Fig 9 tne scanner 1 0 is shov/n as 
being moved across an original 44 having a block 46 
imprinted onto a surface of the original Because the 

IS scanner 10 is not subjected to any kinematic constraints 
in the plane of the original there is a tendency lor a user 
to follow a curvilinear path across the original, as when 
the hand and forearm of the user rotate aboui the elbow 
In Fig 9 the scanning device is snown as following a 

20 curved path 43 across tfie block 46 If the lower edge of 
the scanning device is the edge tf iat is closer to the el- 
bow that defines the axis of rotation the lower edge will 
have a shorter radius Consequently, imaging elements 
of an imaging sensor will vary with respect to the time 

25 and distance required to pass over the block 46. A dis- 
torted image 50 of the block is captured as the device 
is moved to the second position 52, shown in dashed 
lines 

The captured image 50 would be the stored image 
30 in the atrsence of processing 1o be described below 
However as the imaging sensor captures data related 
to the block 46. navigation information is acquired. In 
the preferred embodiment, one or more navigation sen- 
sors capture data related to surface irregularities of the 
35 original 44 Movement of the surface irregularities rela- 
tive to the scanning device 10 is tracked in order to de- 
termine displacement of the imaging sensor relative to 
the block 46. A faithful captured image 54 may then be 
formed The image 54 is defined herein as the "rectified" 
-^0 image. 

In Fig 10, one embodiment of navigation process- 
ing is shown. The navigation processing is performed 
by correlating successive frames of navigation informa- 
tion, such as data representative of the illumination pat- 

-^5 tern formed by highly reflective raised surface features 
and the shadowed areas between raised surtace fea- 
tures. The correlations compare the positions of the fea- 
tures in successive frames to provide information relat- 
ed to the position of a navigation sensor at a particular 

so time The navigation information is then used to rectify 
image data The processing of Fig 10 is typically per- 
formed for each navigation sensor 

In a first stop 55, a reference frame is acquired. In 
effect, the reference frame is a start position. The posi- 

55 lion of a navigation sensor at a later time may be deter- 
mined by acquiring 58 a sample frame of position data 
from the navigation sensor at the later time and then 
computing correlations 60 between the reference frame 
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.-irrj !no Iritor -Hcc; jircd Snrnplo frarn»? 

pl.-jce upon inriat on of '.he- irnaging d^ccgss ^or Gxaf7^- 
V*'.' tho acc:ui:.::0-~} rr..-iy be If iqgc'od by mcro plHcemcft 
'::•'! the scH'Tunq dovico i-iU: rcraacl v.,'/; the c^riqinnl A - : 
lor'i.itivclv tnc ocrirViinq dt-vico rnav I'lCiud-v d slnrt bul- 
l'/-'; t'vi! ifiili.iloi Iho im.ig>:- process and inc nj-nigat ion 
pfo:oss IrilL'jtion rriay aiso U-iko pL-::o b/ n periodi: 
pLJ-iiing ol the I'lur ninalion sys-Iom of c-iCh r-i:Vvigator If 
Ih-oro iG a rcfloclC'd s:cn;i th -t oxccods <-i prGscr:bod 
tfuc-shoid cl reflccticn oi .1 cofrclaton s:gnc-il that nd.- 
Cr-fos moli;,Mi thie rotorcnco *rariio is then acquired 

While the na»/.ga!ron firccossing is poMr-rmGd corr- 
puiationally the :oncoptc. tbiiS ombodirriGnt may bo 
dosc'ibocWyith rciof onc-j I'S' r igs lOandll A rofercnco 
tfanic 62 o- thj il urrinalio'- pallorn is sho^\n as having 
an unagc ol a I -t-hapod leatuio 64 I he si/g ot ihe rot- 
Gfcnce frame deponrjs upc-r fac:ors such as the max - 
mum scanning speed of tr.e scanning devic e the dorr- 
in.'jMl sp.-il.r:! fftjqucnicios if the ifnaciru: of Ihe slructufal 
tcrjlures cind Ihe iiririgo ie;.,-jlijt.o: ■ oMhe sonsof A prac- 
ttcal si/c of the reference frame for a navigation sensor 
that .s thirty-two pixels (N) by sixty-four pixels {^) is 
24x56 pixels 

At a later tirric (dl) a n.ivignnon sensor acquires a 
sample frame 56 of tno illumination pattern wh>ch is dis- 
placed with rosf)oct to frame 62. but wnich snows sub- 
stantially the same features incli..ding the T-shaped fea- 
ture 64 Tno duration dl is profe^?ibly set such that the 
relative displacr nient of Ihe T-shaped feature 64 is less 30 
than one pixel of the navigatiori sensor at the volocily of 
translation of the scanning device An acceptable time 
period IS 50 ps tcr velocities of 0.45 meters/sec at 600 
dpi 

I! the scanning device has moved dunng the time 35 
period between acquiring 56 the reference frame 62 and 
acquiring 53 the sample frame 66, the first and second 
images of [he T-shaped feature will be ones m which the 
feature has shifted While the preferred embodiment is 
one in which dt is less than the lime that allows a full- -^o 
pixel movement the schematic representation of Fig, 11 
shows the feature 64 as having shifted upwardly and to 
the right by one pixel The f jll-ptxel shift is assumed only 
to simplify the representation. 

Element 70 in Fig 1 1 represents a sequential shift- -5 
ing of the pixel values of frame 66 into the eight nearest- 
neighbor pixels Thai is, step "0" does not include a shift, 
step "1" IS a diagonal shift upward and to the left, step 
"2" IS an upward sfiift. etc In this mannei the pixel-shift- 
ed frames can be combined with the sample frame 66 ^0 
to produce the array 72 of position frames The position 
frame designated as "Position 0" does not include a 
shift, so that the result »s merely a combination of frames 
62 and 66 "Position 7" has the minimum number of 
shaded pixels and therefore is the frame with the high- 55 
est correlation Based upon the correlation results, the 
position of Ihe T-shaoed feature 64 in the sarnpfe frame 
65 IS determined to be a diagonal rightward and upward 



shift rointive to the pZ'S>:\r,r o' tno sa-ne foalu^o ir^ oarlier- 
anc^ijir'-^rj rnfr-ronce frruno 6? whrh implies 'hat the 
s:ann'ng device ha3 rrcved .cfl/^ardly and co;vnw-i,' dly 
ajnnc lime d: 

W'-i!g other c::roL-::ion apjr::xichcs rTi-.y be ern- 
P'oyo:: an acceplibic approt-icf^ a "sjrri of Ifio 
squared differences" coftelal on To: the embodiment Df 
Fig 1 ' there are nine correLiticn coetlcients ( C- 
C^) wormed Uom the nine oftsels at eiernent 73 
v,;tfi the coirola-.fcn coe{i,:ients being delem-ined by 
equal, Cf^ 



i : 

where S^^ denotes the navigation soesor -fricastred val- 
ue ai rc position 11 of the Srimpie trrir^ic 6t and R,j dc- 
n'.;les the navicalion serisor-m.easured value a: trie 
fiarne 62 as bhified dt ttte element 70 m the k direction, 
with k being the identifier of the shift at clement 70 In 
Fig 11 k- 3 provides the correlation coefficient with the 
lowest value 

Co-rcl.-itions are used to find the locations of iden 
tical features m successive frames m order to determine 
the displacements of the features from frame-tC'-framie 
Summing or integrating these dtsplacefTicnls and cor- 
recting for scale factors introduced through the design 
of the relevant optics determine the displacement? of 
the imc:ging sensor as a scanning procedure progress- 
es 

After the correlation step 60 of -ig 10 has been ex- 
ecuted for a sample frame acquired at step 55 a deter- 
mination is made as to whether to maintain or replace 
the reference frame This is shown as step 74_ If the 
same reference frame is to be usee for subsequent cor- 
relation computation, the process returns to step 58 and 
a now sample frame is acquired. On the other hand, for 
applications in which there is to be a substitution of ref- 
erence frames step 76 shows the use of the previously 
acquired sample frame as a new reference frame prior 
to returning to step 53 to acquire a new sample frame 

While the process provides a high degree of corre- 
lation match, any errors that do occur will accumulate 
with each successive shift 76 of a Srjrnpic frame 66 to 
the reference frame designation. In order to place a re- 
striction on tfie growth rate of this "random walk" error, 
a sample frame is stored in a separate buffe* memory 
This separately stored sample frame becomes a new 
reference frame for a subsequent series of correlation 
compulations As an example, the new reference frame 
may be introduced after a fixed number of correlation 
computations 

The sampling period dt does not have to be con- 
stant The sampling period may be determrned as a 
function of previous measurements C'no method that 
employs a variable dt is to improve the accuracy of dis- 
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plHcemont calculation by keeping the relative displace- 
monl bolwoen succoss-vn reference frames within cor- 
iHin bounds For example the upper bound may be one- 
pixel displacement while the lower bound is determined 
by numerical roundctt considerations In the processing 
of the navigation data 

Referring again to Fig 11 the T-shaped feature 64 
may bo a shadow that is cast by directing light from an 
tllumination source at an angle of less than sixteen de- 
grees relative to the surface of the original On the other 
hand the feature may be representative of a raised area 
on the surface so that the area is highly reflective Thai 
IS the feature may be a low intensity feature or a high 
intensity feature 

In one embodiment the pixels of the reference 
frame 62 reprcseni a liold of view of 40 ^im The actual 
cross section ot each sensor element of the navigation 
array is 60 pm The optical olcmcnts of this embodiment 
provide a magnificaiion of iSO'^o It should be noted in 
Fig 9 that ihe delected feature 64 has a cross section 
of at least two fields of view A 2 1 laiio of leatuie-to- 
field of view is dictated by Nyquisl criteria For use of 
the method and device in reproducing an image of the 
surface of the original, the high intensity and lov^ inten- 
sity (calurcG may be a result of surface roughness 
formed by a screen in the rr.anufacluring process of the 
paper Typical cross sectional dimensions of paper fib- 
ers are m the range of 25 um to 40 pm. Thus, tracking 
paper fibers is typically not desirable 

Projocling light at les-^. than sixteen degrees relative 
to the surface of the original causes surface features 
that are typically not delectable to the human eye to cast 
shadows that provide an illumination pattern having suf- 
ficient depth of intensity modulation to allow tracking of 
features that satisfy the above-identified cross section 
requirement Additionally printed matter may be im- 
aged, since the raised print will cast shadows when illu- 
minated by light that is projected at an angle of less than 
sixteen degrees relative to the paper on which the print 
IS located 

The direction in which light is projected relative to 
the direction of travel ot the sensor array that is used to 
capture image-reproduclion or position-encoding infor- 
mation is one major factor ot the signal-lo-noise ratio for 
the processing ol the information Another important 
factor IS the number of sensor elements The greater the 
number of sensor elements in the direction perpendic- 
ulai to travel the greatei the number of high intensity 
and low intensity features that will be captured in each 
frame Since the capture of features provides informa- 
tion of the tracking of the path of the sensor array, a 
greater number of sensor elements will increase the sig- 
nal portion of the ratio Thus, the "weakness" of the di- 
rection of illumination with respect to array travel per- 
pendicular lo the illumination direction can be offset by 
an increase in the number of sensor elements in that 
pt^rpendicular direction A third factor in the determina- 
tion of the signal-to-noise ratio is DC removal DC remov- 



al suppresses ilium nation charactons'ics that are com- 
mon within a neighborhociTj of sensor ntomonts DC re- 
moval circuits transform an original frame 62 into an im- 
age of local differences Tne local differences approach 
5 results in an imago in which low spalinl froquoncies arc 
removed thereby facilitating correlations DC removal 
is most easily carried out m a row-by-row fashion wiih 
local differences ta^-cn only along the rows during the 
transfer of pixel values in the frame along the rows of 
w pixel values If the roniovai of DC corinponents is to be 
carriedoul in a row-by-row fashion a column*by-column 
fashion, or both the selection of the fashion may be 
made in accordance with oftsetling the weaknesses of 
one or both of the other im.porlant factors in determining 
IS the signal-to-noise ratio 

Thus there are a number of ways ol oflsetting the 
correlation function asymmetry introduced as a function 
of the direction of relative movement between a sensor 
array and a surface ol interest Fig 1 2 illustrates an em- 
^0 bodiment lor reducing the effects of this factor in tlie in- 
troduction of asymr-rietiy The embodiment of Fig 12 il- 
lustrates cross-structured grazing illumination In the 
preferred embodimortt. a first source 100 of illumination 
is onenled generally along the direction of rows of sen- 
25 sor Clements in the sensor array A second illumination 
source 102 is oriented generally along the direction of 
the columns in the sensor array The target region of a 
medium is divided into two regions 104 and 106. since 
each of the sources is positioned to illuminate only a 
30 portion of the total area to be imaged Optionally, there 
IS an overlap of the two regions If each illuminated re- 
gion 104 and 106 approximately equal in size, e.g.. 
32x32 pixels, the entire sensor array may be 32x64 
sensor elements However there is typically someover- 
35 lapping as the illumination from one of the two sources 
"spills over" into the other region The overlap does not 
seriously reduce the image contrast 

The sources 1 00 and 1 02 may be LEDs that gener- 
ate beams 108 and 110 with narrow angles of diver- 
■io gence measured in their planes of incidence parallel to 
the surface normal Each beam has an angle of inci- 
dence 1 1 2 and 1 1 4 that is less than sixteen degrees rel- 
ative to the associated region 104 and 106 of the medi- 
um. Each region is simpltstically shown as having three 
-^5 shadows thai extend in directions generally perpendic- 
ular to the associated beam 108 and 110. The cross- 
structured Illumination of Fig. 12 significantly reduces 
the correlation function asymmetry 

The disclosuies in Drilled States patent application 
50 no. 08/627,625. from which this application claims pri- 
ority, and in the abstract accompanying this application 
are incorporated herein by reference 

55 Claims 

1 . A method of acquiring data related to topography of 
a medium comprising the steps of 



11 



EP 0 800 307 A2 



linn ^.-I'lrcp i'^- 41 4Q 5S 100 10?) Hr.d 

Hn Hrrdy of scr^sor oloments (24 26 73) in 
whicfi c.icr"i S'lnsor olcmont h,-i --i l.oici o' view 
:iirocl fv:j rndi.it on Uo'r\ shic: lliL:^r.!n.^^ c-n sourco ^' 
.it H suT-ricc Sciid rnc::'Uf'i sjc !h-i' said rn- 
iJiritiof! doftrcs ri p.-iir tn.ji is sub:.iH.nii.^;iy f xcd 
rol-itivo to s.TirJ sens-Gf invilucn:: establishing 
d firit^- lo to Ht fin rinqlc 112 114) less thnn 
sixteen :::e9'ces rclniivo lo i.-ii'J lu-^acc ihcrc- 
tjy fotming an ifluntn.-it.Of^i pHttorn or fit lo.isl <-i 
pO'tiC'f- of SHk-J surtaco sucfi U'.hI Sc-iid r un^ina- 
lion prittorn n-: ludos lirst Hf oas (64) of relatively 
tiiqh briphlne^-s cc-rr ospc-ndin:] lo r^-itsed sur- 
facG features said medium and second areas 
o\ :olaiivo!y Ic-v; bngMficss 
proviciing [oI.-:ivc- movervioni between said 
eitijcuro and caid rr.odtuai 
du'inc:) s.-id stt}D of providing relaii.'c m^)vornert 
airJ by moans of said st^nsor dolecling (56 53) ^0 
t-ri'd fiiot aiea-.^ of lelatively litgti biiqfttness and 
sa.d secono areas of relatively lo// brightness 
and 

forming an im^igc (54) of g,:iic surface of said 
medium including ti.:Kkina positions (72) of 
£.a;d first and SGCond areas during said step of 
providing relative mDvemont iri order to dotcr- 
mino at least one of position encoding informa- 
tion and image information 

30 

2. A method as in claim 1 . whereir said step of duect- 
ing ^a:iia^l^n includes coliimating radiation from an 
incohereni illjminaiion source (26. 30 41. 49. 55. 

100 102) 

35 

3. A method as in claims 1 and 2. wherein said step 
of providing said structure (10) includes providing a 
two-dimensional array of sensor elements, said 
step of detecting said first and second areas includ- 
ing positioning said array at or gcnGrally parallel and -fo 
near to a conjugate image plane of said surface of 
said medium (14 44) 

4. A method as m claim 1 , 2 or 3, wherein said step of 
detecting sairJ first and second areas includes the -f^ 

stop of forming successive images (55, 55 62, 66) 
of p'imarily only those first and second areas having 
a dirncnsiof 1 al least twice as large as a dir?^.ensiori 
of said field of view of each sensor element, said 
step of form ng an image (54) including tracking so 
said first and second images in said successive im- 
ages to determine position encoding information 
(50) 

5. A method as in claim 4 wherein said step of forming 55 

an image (54; includes CGtectmg print information 
on said surface in a manner inoopondent from use 
of said sensor elements 



6 '-noi-K:,^} HS ir^ ar-\, rfc-:oa.:rg ci<-!>'"i wherein s.-! •:: 
stop o'' rj;rorl;:v- :H:^■r^Unr in ~ I udos ril t,-tr inc a prfS'r- 
(3' 3r t to said structure < 10) tc bo wilhir- a first path 
\'zr\ said ill jminaiion source to s-iifi rrioaium (14 
ri' :: 44, .and wit'^'in .-i second path frorT^, s.iid medium 
tc -i-'iid ':24, o! sC'nsor elements 

7. A f'lctnod as in claim 6 compasinu the step of di- 
rectuiq a Dlur.-iiity of be-irns of ligf^it (41 4^) into said 

pr.sm ;:3r i SLJCh that s<^ d pnsrr fcd.:octs each bea-r: 
Ic approach said surace at an angle cf less than 
si>'e<:n degrees from sad surface 

8. A cevice lor acquinrig data relatec to topog-aphy of 
ri mejiu.-r. comprismc 

a hand-manipjiatab e housing ( :U) including a 

Generally planar taoC' fo" posit ion irig in substan- 
tially pa'aliol relatior^ship with a surface of said 
medium 

an illjdiinatioi I source (25 30 41. 49. 55. 100 
102) connected to said housinii^ at said planar 

face 

an array (24. 26 73) of sensing elements posi 
tionod along said planar face and 
an optica! arrangement (31 36 53) connected 
to said housing for directing light from said illu- 
mination source to reach said surface at an an- 
gle (112 114) of less than sixteen degrees rel- 
ative to said surface and for redirecting scat- 
tered light from said surface to impinge said 
sensing elements 

9. A device as in claim 5. wherein said optical arrange- 
ment includes a prism (31 38) including a prism 

face (35 36: 39. 40) distal to said housing (10) and 
substantially parallel lo said planar face 

10. A device as in cfaim 9. wherein said illumination 
sourco (26. 30: 41: 49) includes a plurality of light 
sources directed to pro ect light energy into said 
pnsm (31. 38), said prism being configured lo re- 
lease said light energy from each of said light sourc- 
es at an angle of less than sixteen degrees relative 
to said surface of said medium (14, 44) 



12 



EP 0 800 307 A2 



Z 
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FIG. 4 




FIG. 5 
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